Collaborative Training of Tensors for Compositional Distributional Semantics

نویسنده

  • Tamara Polajnar
چکیده

Type-based compositional distributional semantic models present an interesting line of research into functional representations of linguistic meaning. One of the drawbacks of such models, however, is the lack of training data required to train each word-type combination. In this paper we address this by introducing training methods that share parameters between similar words. We show that these methods enable zero-shot learning for words that have no training data at all, as well as enabling construction of high-quality tensors from very few training examples per word.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Multi-Step Regression Learning for Compositional Distributional Semantics

We present a model for compositional distributional semantics related to the framework of Coecke et al. (2010), and emulating formal semantics by representing functions as tensors and arguments as vectors. We introduce a new learning method for tensors, generalising the approach of Baroni and Zamparelli (2010). We evaluate it on two benchmark data sets, and find it to outperform existing leadin...

متن کامل

Low-Rank Tensors for Verbs in Compositional Distributional Semantics

Several compositional distributional semantic methods use tensors to model multi-way interactions between vectors. Unfortunately, the size of the tensors can make their use impractical in large-scale implementations. In this paper, we investigate whether we can match the performance of full tensors with low-rank approximations that use a fraction of the original number of parameters. We investi...

متن کامل

Towards a Formal Distributional Semantics: Simulating Logical Calculi with Tensors

The development of compositional distributional models of semantics reconciling the empirical aspects of distributional semantics with the compositional aspects of formal semantics is a popular topic in the contemporary literature. This paper seeks to bring this reconciliation one step further by showing how the mathematical constructs commonly used in compositional distributional models, such ...

متن کامل

Reducing Dimensions of Tensors in Type-Driven Distributional Semantics

Compositional distributional semantics is a subfield of Computational Linguistics which investigates methods for representing the meanings of phrases and sentences. In this paper, we explore implementations of a framework based on Combinatory Categorial Grammar (CCG), in which words with certain grammatical types have meanings represented by multilinear maps (i.e. multi-dimensional arrays, or t...

متن کامل

*SEM 2013: The Second Joint Conference on Lexical and Computational Semantics

The development of compositional distribu-tional models of semantics reconciling the em-pirical aspects of distributional semantics withthe compositional aspects of formal seman-tics is a popular topic in the contemporary lit-erature. This paper seeks to bring this rec-onciliation one step further by showing howthe mathematical constructs commonly usedin composit...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:
  • CoRR

دوره abs/1607.02310  شماره 

صفحات  -

تاریخ انتشار 2016